Critical Appraisal of Anesthesiology Educational Research for 2019.

Background: This study reviews and appraises the articles published about anesthesiology education in 2019. Through this critical appraisal, those interested in anesthesiology education are able to quickly review literature published during this year and explore innovative ways to improve education for all those involved in the practice of anesthesiology. Methods: Three Ovid MEDLINE databases, Embase.com, ERIC, and PsycINFO were searched followed by a manual review of articles published in the highest impact factor journals in both the fields of anesthesiology and medical education. Abstracts were double-screened and quantitative articles were subsequently scored by 3 randomly assigned raters. Qualitative studies were scored by 2 raters. Two different rubrics were used for scoring quantitative and qualitative studies; both allowed for scores ranging from 1 to 25. In addition, reviewers rated each article on its overall quality to create an additional list of top articles based solely on the opinion of the reviewers. Results: A total of 2374 unique citations were identified through the search criteria and the manual review. Of those, 70 articles met the inclusion criteria (62 quantitative and 8 qualitative). The top 12 quantitative papers and the top 2 qualitative papers with the highest scores were reported and summarized.Conclusions: This critical appraisal continues to be a useful tool for those working in anesthesiology education by highlighting the best research articles published over the year. Highlighting trends in medical education research in anesthesiology can help those in the field to think critically about the direction of this type of research.

Critical Appraisal of Anesthesiology Educational Research for 2018.

BACKGROUND: Through a critical appraisal of the education research in anesthesiology, this article enables those interested in the field to read the high-quality articles for the past year and possibly implement these evidence-based interventions and concepts into practice. This study reviews and appraises all medical education studies published in 2018 in anesthesiology and summarizes the highest-rated articles evaluated. METHODS: Three Ovid MEDLINE databases, Embase.com, ERIC, PsycINFO, and PubMed were searched followed by a manual review of articles published in the highest impact factor journals in both the fields of anesthesiology and medical education. Abstracts were double-screened and quantitative articles subsequently scored by 3 randomly assigned raters. Qualitative studies were scored by 2 raters. Two different rubrics were used for scoring quantitative and qualitative studies, both allowed for scores ranging from 1 to 25. RESULTS: A total of 888 unique citations were identified through the search criteria. Of those, 39 articles met the inclusion criteria (36 quantitative and 3 qualitative). The top 11 quantitative papers and the top qualitative paper with the highest scores were reported and summarized. CONCLUSIONS: As the second article to critically review the literature available for education in anesthesiology, we are able to add to this annual series to help further disseminate the articles of the highest quality in anesthesiology education. Because this is only the second year, we can only report on initial suggestions of trends that we hope will help guide future research.

Measuring Coaching in Undergraduate Medical Education: the Development and Psychometric Validation of New Instruments.

BACKGROUND: Coaching is emerging as a novel approach to guide medical students toward becoming competent, reflective physicians and master adaptive learners. However, no instruments currently exist to measure academic coaching at the undergraduate medical education level. OBJECTIVE: To describe the development and psychometric assessments of two instruments designed to assess academic coaching of medical students toward creating a robust measurement model of this educational paradigm. DESIGN: Observational psychometric. PARTICIPANTS: All medical students in the 2014 and 2015 cohorts and all their coaches were invited to complete the instruments being tested, which led to 662 medical student responses from 292 medical students and 468 coaching responses from 22 coaches being included in analyses. Medical student response rates were 75.7% from 2014 and 75.5% from 2015. Overall, the coaches' response rate was 71%. MAIN MEASURES: Two 31-item instruments were initially developed, one for medical students to assess their coach and one for faculty coaches to assess their students, both of which evaluated coaching based on definitions we formulated using existing literature. Each was administered to two cohorts of medical students and coaches in 2015 and 2016. An exploratory factor analysis using principal component analysis as the extraction method and Varimax with Kaiser normalization as the rotation method was conducted. KEY RESULTS: Eighteen items reflecting four domains were retained with eigenvalues higher than 1.0 for medical students' assessment of coaching, which measured promoting self-monitoring, relationship building, promoting reflective behavior, and establishing foundational ground rules. Sixteen items reflecting two domains were retained for the faculty assessment of coaching with eigenvalues higher than 1.0: the Practice of Coaching and Relationship Formation. CONCLUSIONS: We successfully developed and psychometrically validated surveys designed to measure key aspects of the coaching relationship, coaching processes, and reflective outcomes. The new validated instruments offer a robust measurement model for academic coaching.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2016.

OBJECTIVES: The objectives were to critically appraise the emergency medicine (EM) medical education literature published in 2016 and review the highest-quality quantitative and qualitative studies. METHODS: A search of the English language literature in 2016 querying MEDLINE, Scopus, Education Resources Information Center (ERIC), and PsychInfo identified 510 papers related to medical education in EM. Two reviewers independently screened all of the publications using previously established exclusion criteria. The 25 top-scoring quantitative studies based on methodology and all six qualitative studies were scored by all reviewers using selected scoring criteria that have been adapted from previous installments. The top-scoring articles were highlighted and trends in medical education research were described. RESULTS: Seventy-five manuscripts met inclusion criteria and were scored. Eleven quantitative and one qualitative papers were the highest scoring and are summarized in this article. CONCLUSION: This annual critical appraisal series highlights the best EM education research articles published in 2016.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2015.

OBJECTIVE: The objectives were to critically appraise the medical education research literature of 2015 and review the highest-quality quantitative and qualitative examples. METHODS: A total of 434 emergency medicine (EM)-related articles were discovered upon a search of ERIC, PsychINFO, PubMED, and SCOPUS. These were both quantitative and qualitative in nature. All were screened by two of the authors using previously published exclusion criteria, and the remaining were appraised by all authors using a previously published scoring system. The highest scoring articles were then reviewed. RESULTS: Sixty-one manuscripts were scored, and 10 quantitative and two qualitative papers were the highest scoring and are reviewed and summarized in this article. CONCLUSIONS: This installment in this critical appraisal series reviews 12 of the highest-quality EM-related medical education research manuscripts published in 2015.

Using the Teaching Perspectives Inventory as an Introduction to a Residents-as-Teachers Curriculum.

Objective: The Anesthesiology Milestone Project includes a milestone for assessing the teaching attributes of residents within the competency of Practice-based Learning and Improvement. We intend to develop a Residents-as-Teachers educational curriculum to assist our residents in successfully achieving this milestone. The goal of this study is to identify the specific teaching perspectives and intentions of our residents and to promote residents' comprehension of their own teaching philosophy. Methods: We invited our residents to complete the Teaching Perspective Inventory (TPI) and a follow-up survey to gather information regarding dominant and recessive teaching perspectives, their intended career pathway, and their view of the importance of understanding teaching perspectives. Results: The two most common dominant teaching perspectives are apprenticeship and nurturing for residents who are planning a career in both academic medicine and private practice. A greater percentage of residents planning an academic career agree that identifying their teaching perspective is beneficial to their role as a clinical educator, compared to those anticipating a career in private practice. Conclusions: Based on this pilot data, our Residents-as-Teachers curriculum will include instruction of educational strategies specifically designed towards the apprenticeship and nurturing perspectives.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2015.

OBJECTIVE: The objectives were to critically appraise the medical education research literature of 2015 and review the highest-quality quantitative and qualitative examples. METHODS: A total of 434 emergency medicine (EM)-related articles were discovered upon a search of ERIC, PsychINFO, PubMED, and SCOPUS. These were both quantitative and qualitative in nature. All were screened by two of the authors using previously published exclusion criteria, and the remaining were appraised by all authors using a previously published scoring system. The highest scoring articles were then reviewed. RESULTS: Sixty-one manuscripts were scored, and 10 quantitative and two qualitative papers were the highest scoring and are reviewed and summarized in this article. CONCLUSIONS: This installment in this critical appraisal series reviews 12 of the highest-quality EM-related medical education research manuscripts published in 2015.

Coaching: a new model for academic and career achievement.

BACKGROUND: Individualized education is emerging as an innovative model for physician training. This requires faculty coaching to guide learners' achievements in academic performance, competency development, and career progression. In addition, coaching can foster self-reflection and self-monitoring using a data-guided approach to support lifelong learning. CONTEXT: Coaching differs from mentoring or advising, and its application in medical education is novel. Because of this, definitions of the concept and the constructs of coaching as applied to medical education are needed to accurately assess the coaching relationship and coaching processes. These can then be linked to learner outcomes to inform how coaching serves as a modifier of academic and competency achievement and career satisfaction. INNOVATION: We developed definitions and constructs for academic coaching in medical education based on review of existing education and non-education coaching literature. These constructs focus on 1) establishing relationship principles, 2) conducting learner assessments, 3) developing and implementing an action plan, and 4) assessing results and revising plans accordingly. IMPLICATION: Coaching is emerging as an important construct in the context of medical education. This article lays the vital groundwork needed for evaluation of coaching programs aimed at producing outstanding physicians.

Critical Appraisal of Emergency Medicine Education Research: The Best Publications of 2014.

OBJECTIVES: The objective was to critically appraise and highlight rigorous education research study articles published in 2014 whose outcomes advance the science of emergency medicine (EM) education. METHODS: A search of the English language literature in 2014 querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 243 EM-related articles using either quantitative (hypothesis-testing or observational investigations of educational interventions) or qualitative (exploring important phenomena in EM education) methods. Two reviewers independently screened all of the publications using previously established exclusion criteria. Six reviewers then independently scored the 25 selected publications using either a qualitative or a quantitative scoring system. Each scoring system consisted of nine criteria. Selected criteria were based on accepted educational review literature and chosen a priori. Both scoring systems use parallel scoring metrics and have been used previously within this annual review. RESULTS: Twenty-five medical education research papers (22 quantitative, three qualitative) met the criteria for inclusion and were reviewed. Five quantitative and two qualitative studies were ranked most highly by the reviewers as exemplary and are summarized in this article. CONCLUSIONS: This annual critical appraisal series highlights seven excellent EM education research studies, meeting a priori criteria and published in 2014. Methodologic strengths in the 2014 papers are noted, and current trends in medical education research in EM are discussed.

Teaching: aligning faculty member and resident perceptions.

PURPOSE: This study sought to examine and address concerns received from residents regarding their perception of the length of time faculty members devoted to intraoperative teaching. METHOD: Faculty members and residents were surveyed on their perceptions of intraoperative teaching. The survey was evaluated using descriptive methods. A disparity was noted between faculty member and resident perceptions of time devoted to intraoperative teaching. To better understand the disparity, a series of focus groups to discuss the survey results were held with both faculty members and residents. To address the disparity, a teaching tool was developed using the keywords of the American Board of Anesthesiology's in-training examination. Faculty members and residents used this tool in the intraoperative environment for 2 months. After 2 months, faculty members and residents were surveyed to see whether a change in perception took place. The use of the teaching tool was continued. Faculty members and residents were surveyed after 1 year of continued use to assess usage and satisfaction with the tool. RESULTS: The pre-intervention survey yielded responses from 29.6 per cent (n = 64) of the teaching faculty members and 29.2 per cent (n = 24) of the residents. The post-intervention survey yielded responses from 64 per cent of the faculty members and 62.5 per cent of the residents. After implementation of the tool, an improved alignment of resident and faculty member perceptions of the time faculty members spent teaching intraoperatively was observed. The majority of faculty members and residents reported continued use and satisfaction with the keyword tool after 1 year of use. DISCUSSION: This experience revealed the importance of making simple, pragmatic changes to improve resident perceptions of intraoperative teaching time.

Expertise, Time, Money, Mentoring, and Reward: Systemic Barriers That Limit Education Researcher Productivity-Proceedings From the AAMC GEA Workshop.

BACKGROUND: To further evolve in an evidence-based fashion, medical education needs to develop and evaluate new practices for teaching, learning, and assessment. However, educators face barriers in designing, conducting, and publishing education research. OBJECTIVE: To explore the barriers medical educators face in formulating, conducting, and publishing high-quality medical education research, and to identify strategies for overcoming them. METHODS: A consensus workshop was held November 5, 2013, at the Association of American Medical Colleges annual meeting. A working group of education research experts and educators completed a preconference literature review focusing on barriers to education research. During the workshop, consensus-based and small group techniques were used to refine the broad themes into content categories. Attendees then ranked the most important barriers and strategies for overcoming them with the highest potential impact. RESULTS: Barriers participants faced in conducting quality education research included lack of (1) expertise, (2) time, (3) funding, (4) mentorship, and (5) reward. The strategy considered most effective in overcoming these barriers involved building communities of education researchers for collaboration and networking, and advocating for education researchers' interests. Other suggestions included trying to secure increased funding opportunities, developing mentoring programs, and encouraging mechanisms to ensure protected time. CONCLUSIONS: Barriers to education research productivity clearly exist. Many appear to result from feelings of isolation that may be overcome with systemic efforts to develop and enable communities of practice across institutions. Finally, the theme of "reward" is novel and complex and may have implications for education research productivity.

Training intensivists and clinician-scientists for the 21st century: the Oregon scholars program.

BACKGROUND: Innovation is important for the development and advancement of any medical specialty. Leaders in anesthesiology have emphasized the need for more training in critical care and additional research to advance our specialty. INTERVENTION: To help address this need, Oregon Health & Science University (OHSU) developed an innovative training program that combines a critical care medicine (CCM) or research fellowship with traditional clinical anesthesia training. This article outlines the program structure, challenges, and successes of this innovative approach to training anesthesiology clinicians and scientists. FINDINGS: Since the program began in 2006, we have filled all available positions and currently have 9 scholars in the anesthesiology/CCM track and 3 in the anesthesiology/research track at the postgraduate year-2 to postgraduate year-5 levels. Our first class of scholars graduated in the summer of 2010. The Oregon Scholars Program (OSP) scholars and faculty have confronted challenges, including the transition from resident in the operating rooms to fellow in the critical care units. In 2007, our residents acknowledged the OSP/CCM scholars' expertise in CCM and have looked to them as teachers and advocates for their education during their CCM rotations. In July 2007, OHSU received a National Institutes of Health T32 training grant to support the research component of the OSP. OSP scholars' research productivity has resulted in 11 publications, 3 abstracts, 3 presentations, 3 research grants, and 1 resident research award. Several other anesthesiology programs have recently instituted similar programs to address the need for anesthesiologists trained as intensivists and clinician-scientists.